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The entropy associated with absolute equilibrium ensemble theories of ideal, homogeneous, fluid and magneto- 
fluid turbulence is discussed and the three-dimensional fluid case is examined in detail. A cr-function is de- 
fined, whose minimum value with respect to global parameters is the entropy. A comparison is made between 
the use of global functions cr and phase functions H (associated with the development of various if-theorems 
of ideal turbulence). It is shown that the two approaches are complimentary though conceptually different: 
if-theorems show that an isolated system tends to equilibrium while cr-functions allow the demonstration 
that entropy never decreases when two previously isolated systems are combined. This provides a more 
complete picture of entropy in the statistical mechanics of ideal fluids. 
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1 Introduction 


The concept of entropy has long been an important and yet a perplexing one. It is important because it 
never decreases when two previously isolated systems are brought together and hence provides an explicit 
measure of irreversibility. It is perplexing because although it has long been recognized that “in particular, 
we cannot speak of its instantaneous value” (Landau & Lifshitz 1980), this is often done (e.g., Lifshitz & 
Pitaevskii 1981). In fact, so-called id-theorems explicitly require the existence of a time-dependent function 
which is assigned the role of a ‘dynamic entropy’ for an isolated system. 

A time-dependent entropy, however, appears to be an oxymoron: entropy measures a certain property of 
an isolated or quasi-isolated system; the entropy is a constant and does not depend on what specific microstate 
the system happen to be in at any particular instant. The classical definition of entropy is S = fe^lnlT, 
where kg is Boltzmann’s constant and W is the number of states available to the system in question. If the 
system is ‘isolated’, IT is a fixed number; it is immaterial in which of the available states the system resides: 
the entropy S has a fixed, time-independent value. Of course, the isolated system may interact with other 
systems and when two or more systems combine into a new system, there is a corresponding, fixed value of 
entropy for this new system. 

Thus, there are two seemingly different views: first, that the entropy of a system is a quantity which is 
fixed when that system is isolated, and second, that the system, when isolated, has an entropy which evolves 
from some intial value towards a different ‘equilibrium’ value. The resolution of this dilemma is to realize 
that what is evolving is not the entropy itself, but the distribution function f of the system. Concurrently, 
an estimate of the entropy called an id -function [id (/) = — f f In fdT where dr is an element of the system’s 
phase space] evolves as / does (the evolution of / being determined by a Boltzmann equation). As / — > /, 
where / is the equilibrium (or most probable or average) distribution, then id(/) — >■ H(f) = S, where S is 
the entropy of the system. Showing that dH(f)/dt > 0 is an important statistical result since it indicates 
that a system, once isolated, tends to evolve to an equilibrium distribution. Notice that the entropy S does 
not evolve; rather id(/) < S if / / and id(/) — > S as / — > f. In fact, the id-function will fluctuate below 

S as f fluctuates about /. 

The id-function is a phase function, that is, a function whose estimate is evolving as the system point 
moves along a phase trajectory, and entropy is the extremum value of id. As Khinchin (1949) emphasizes, 
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entropy can also be expressed as the extremum value of a thermodynamic function, i.e., a function of global 
thermodynamic parameters; here, we will call this function cr. However, whereas H is a function of the 
evolving distribution / (a function of time), cr is a function of the a prion probability density D (a function 
of global quantities such as the temperature T). The difference between the two functions is that while 
entropy is the maximum value of H (/) with respect to time, it is the minimum value of cr(D) with respect to 
global thermodynamic parameters. This is a very important property of cr as it allows the demonstration that 
entropy never decreases when two isolated systems are combined into one. [Note that this is conceptually 
different from dH(f)/dt > 0, which only shows that an isolated system evolves towards equilibrium.] 

2 Statistics of Ideal Fluids 

In this paper, we will be concerned with entropy as related to finite (Fourier) representations of incompress- 
ible, homogeneous, ideal [i.e., non-dissipative) fluids and magneto-fluids (so that whenever the words fluid 
and magneto-fluid are used, incompressibility, homogeneity, and ideality, if not explicitly stated, are always 
implicit). To illustrate the general concepts, the particular case of an ideal three-dimensional (3-D) fluid 
will be considered in detail. The goal is to more completely understand how turbulence can be described in 
terms of statistical mechanics; integral to this understanding is a description of entropy and the role it plays. 

It is well known that the classical thermodynamic entropy of each fluid element in an isolated, ideal fluid 
is conserved (Landau & Lifshitz 1987); here, we are interested in developing the properties of the absolute 
equilibrium entropy. The classical entropy, in terms of the probabilities p n that a physical system is in 
a microstate n, is defined as S = — ^2 n Pn^Pn (dimensionless units will be used here, so that kg = 1). 
Similarly, in an absolute equilibrium ensemble, the entropy is determined by finding the extremum of the 
function cr = —f D In DdT, where D is the a priori probability density in the phase space T whose axes 
correspond to the independent real and imaginary components of the Fourier velocity coefficients (Shebalin 
1989). The probability density D depends on the integral invariants of the motion: for 2-D fluids, these are 
the energy and enstrophy (Kraichnan 1975, where absolute equilibrium is also discussed); for 2-D magneto- 
fluids, the energy, cross helicity (Woltjer 1958), and mean-squared magnetic potential (Fyfe & Montgomery 
1976, where absolute equilibrium is also discussed); for 3-D fluids, the energy and kinetic helicity (Betchov 
1961, Moffatt 1969); and for 3-D magneto-fluids, the energy, cross helicity (Woltjer 1958), and magnetic 
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helicity (Elsasser 1956). Additionally, if the mean magnetic field is non-zero, then the mean-squared magnetic 
potential is not conserved in 2-D ideal magneto-fluids (Shebalin, Matthaeus & Montgomery 1983), while in 
3-D ideal magneto-fluids, the magnetic helicity is no longer an invariant (Shebalin 1994). For 3-D fluids, 
a detailed discussion of absolute equilibrium was given first by given by Kraichnan (1973), and for 3-D 
magneto-fluids, a detailed discussion was given first by Frisch, Pouquet, Leorat & Mazure (1975). 

In order to demonstrate that equilibrium (t.e., a most probable state) is attained by an isolated turbulent 
fluid, several paths have been taken to develop an Tf-theorem. Montgomery used a BBGKY format to arrive 
at an H-theorem which shows that a function (here denoted as) H = — J fin f dT never decreases with time 
(Montgomery 1976); again, / is the time-dependent distribution function in phase space. An Tf-function 
for fluid mechanics was also developed by Carnevale, Frisch & Salmon (1981) and Carnevale (1982). They 
identify Hq = \ XOk l n | u (k )| 2 as an ‘entropy functional’ [where the G is for Gibbs and the u(k) are the 
coefficients associated with a truncated Fourier expansion of the turbulent velocity Held]. Again, it is better 
to call Hq an Tf -function rather than entropy function(al) for the reasons given above. A comparison of Hq 
and the cr-function to be developed will be made and discussed presently. 


3 Absolute Equilibrium 


The equation which describes ideal, incompressible 3-D fluid dynamics is the Euler equation; in ‘vorticity 
form’ it is: 


doj 

~dt 


V x (u x u>) . 


( 1 ) 


Here, the fluid velocity is u and the vorticity is u = V x u. If the physical variables u and w are expanded 
in a finite Fourier series, we have, for example: 


u(x) = 5>( k )e ik ' x . ( 2 ) 

k 

Time dependence of both u(x) and u(k) is implicit; also, w(k) = ik x u(k) and u(k) = ik~ 2 k x w(k). 
Furthermore, since the velocity field is real, its coefficients must satisfy u(k) = u*(— k), where denotes 
complex conjugation. 

Conservation of integral invariants will occur even if the sum in (2) is taken over an arbitrary collection 
of wave numbers k (Kraichnan & Montgomery 1980). The finite set of k can be chosen so that all k such 
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that 0 < |k| < k max < N / 2 are included, where N is the order of the Fourier transform in each dimension. 
This is an isotropic truncation, but it is only one possibility out of many. In particular, two disjoint sets can 
be created: k £ K and k' £ K' , such that K 7 ^ 0 and K' 7 ^ 0 but K fl K' = 0; it will, however, be assumed 
that if k £ K then — k £ K, and similarly for K' . Furthermore, let M be the total number of wave vectors 
in K; since u(— k) = u*(k), the number of independent wave vectors is Z = \M . 

It was pointed out by T. D. Lee (1952) that the structure of (1), with a periodic solution of the form 
of (2), admits a statistical solution because a ‘Liouville theorem’ is satisfied. Again, the components of the 
independent real and imaginary parts of the coefficients u(k) are used to label the axes of a multidimensional 
phase space; the corresponding dynamical system is described by a single point in this phase space, a point 
which moves about as the system evolves in time. The probability that the system point is in any part of 
phase space can be described by a canonical probability density D which depends only on a small set of 
conserved quantities, the integral invariants of the dynamical system. Once D has been found, then the 
equilibrium energy spectrum can be determined, even though the u(k) are random variables. 

In the case of isotropic, incompressible 3-D Euler turbulence, the integral invariants are the energy E 
and the kinetic helicity Elk (Betchov 1961): 

A=|^| u (k )| 2 and H k = | ^ u(k) • w*(k), (3) 

1 keif 1 keif 

while the absolute equilibrium probability density (Kraichnan 1973) is 

_ ( _ /?2l.2\ I 

D = C exp (-aE - (dH k ) where C = — j . (4) 

keifz ^ ^ ' 

The product above is taken over the set Kz- k £ Kz implies k £ K, but — k ^ Kz', thus, Kz has half the 
elements of K. (To create Kz, start with Kz empty and then choose each k £ K in turn and place it into 
Kz, if — k is not already there.) 

The model system, in which ideal turbulence is simulated numerically by integrating a Unite Fourier 
representation of equation ( 1 ) forward in time, is canonical as it can be considered a small system (a 
computer code) weakly interacting with a larger ‘heat bath’ (a digital computer). The ‘weak interaction’ is 
due to numerical round-off and time-discretization errors, which cause very small fluctuations of E and H k ', 
it is within this context that these are called ‘integral invariants’ of a ‘quasi-closed’ system. 
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Using the probability density D in (4), the expectation value of any quantity Q can be defined as 


(Q) = / QDdT, where dr = du/{(k) du/(k) 

J kG K z 


( 5 ) 


where the integration limits on each dimension are — oo to oo, and where the subscripts R and I denote real 
and imaginary parts, respectively, of the complex coefficients. Using (5), expectation values of the moments 
of the Fourier coefficients can be easily found (since D is essentially gaussian): 

3a 


(uii(k)> = (u/(k)> = 0 , (|u fi (k)| 2 ) = (|u/(k)| 2 ) = 


2 (a 2 - (3 2 k 2 )' 


and (u.R(k) • w.R(k)) = (u/(k) • w/(k)) = 


-3 (3k 2 


( 6 ) 


2 (a 2 — (3 2 k 2 ) ’ 

where all the components of u(k) for a given k have equal expectation values. Substituting (6) into (3) gives 
the expectation values 


<*> = *£ 


2 ^ a 2 — (3 2 k 2 

kG K ' 


and (H k ) = -~Y^ 


/3k 2 


2 ^ a 2 — /3 2 k 2 ' 

kG K ' 


( 7 ) 


Since the energy and kinetic helicity are canonical invariants, they are conserved to within very small 
fluctuations, and their values over time are essentially the same as either their initial or time-averaged 
values. Thus, the relations (7) implicitly determine the ‘inverse temperatures’ a and [3 in terms of (E) and 
{Hu). 

Other global quantities, such as the enstrophy £2, will generally have large fluctuations; nevertheless, the 
enstrophy also has an expectation value: 


n= 1 -J 2 k2 Iu(k)l 2 =>• = 


k eK 


2 ^ a 2 - f3 2 k 2 ' 

k eK ^ 


( 8 ) 


Using (7) and (8), the following algebraic relations are arrived at: 

a(E) + (3(H k )= | ^ 1 = 3Z, a(H k )+/3(Q)= 0. 

Z kG K 

Thus, both a and [3 can be considered functions of one quantity, (£2): 


(9) 


3Z (£2) 


and (3 = 


-3 Z(H k ) 


( 10 ) 


(E) (£2) - (H k y (U)(£2) - (H k y 

Using (3) and (8), it is straightforward but tedious to show that (E) (£2) — ( H k ) 2 > 0; thus, from (10), a > 0 
and the product (3 (H k ) < 0. Furthermore, under coordinate inversion, (H k ) — > — (Hk), while neither (E) nor 
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(12) change sign; thus, though a is a scalar, [3 is a pseudoscalar under a parity transformation (i.e., coordinate 
inversion). Note that (1) is invariant under a parity transformation; the fact that [3 is a pseudoscalar ensures 
that the probability distribution (4) is also invariant. Also, for ideal magneto-fluids, the ratio R of magnetic 
energy to kinetic energy is used in place of SI (Shebalin 1989, 1994; Stribling & Matthaeus 1990). 


4 Entropy 


At this point we are in a position to define the entropy of an absolute equilibrium ensemble and to develop 
its properties. Consider now the expectation value of lnH; using (4), (5), and (9), 


<7 = — (In D) 


DlnDdV 


= a (E) + f3 (H k ) — In C 


= 3Z-\nC. 


( 11 ) 


Note that u is a function of a and [3 through (4). In turn, a and [3 are determined by (10); however, in 
examining (10), it is clear that a and [3 cannot be determined unless ( E ), (Hk), and (SI) are known. Prior 
to performing a numerical simulation (Shebalin 1989, 1994), however, all that is known is that ( E ) and (Hk) 
are constants, while (SI) is unknown. In this case, set (E) = E, (Hk) = Hk, and (SI) = SI; then E and Hk 
can be taken as the initial values (which are known when the initial conditions are known), and the value of 
SI is variable, with H% < SI < kl nax E. 

Using the above assignments, the inverse temperatures a and /?, as given in (10), become: 


3ZI2 

Eft -Hi 


and [3 = 


-3 ZH k 
Eft - Hi ' 


( 12 ) 


Also, using (4) and (11), the dependence of a on these inverse temperatures takes the form: 


cr = <j 0 In (a 2 — f3 2 k 2 ) where cr 0 = 3Z (1 + In 7r) + 3 ln& 2 . 


(13) 


k €K Z k£ K z 

Putting (12) into (13), a is seen to be explicitly a function of only one variable parameter, S2: cr = <r(£2). 

Although we now have <r(S2), what is the advantage in this? In other words, why not solve the system of 
equations (7) directly for a and /?, place these into C as given by (4), and put this, in turn, into (11), giving 
the entropy S = cr? The advantage, as Khinchin (1949) points out, is that we can now demonstrate that 
entropy never decreases when two previously isolated systems are brought together. 
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The function a = 3 Z — In C defined in (11), and more explicitly in (13), is exactly analogous to (83) of 
Khinchin (1949). It can be shown directly, or by referring to the more general results of Khinchin (1949, pp. 
76-77), that cr(Sl) has only one extremum cr'(Sl) = da / di2 = 0 at SI = Cl and that cr"(Sl) > 0. Thus, SI = Cl 
is a point of global minimum for cr(Sl); the entropy of the canonical system is S = a(fi). All of this allows a 
direct proof that entropy increases when two isolated systems are brought together (Khinchin 1949). 

Consider two sets of wave vectors and K ( 2 ) such that fl K ( 2 ) = 0 and U K ( 2 ) = K; also, 

M = M W + M< 2 ) and Z = Z W + Z l ' 2 \ Looking at (3), (4), (5), and (8), it is clear that 

E = EW + E^\ H k =H^ + H^\ Sl = Sf( 1 )+Sl( 2 ), 

d = d { 1 ) d {2 \ 0 = 0^0^, dr = dr ( 1 ) dr (2) . (14) 

Using these results, along with (11) gives us 

o-W + crf 2 ) = 3 \z^ + Z< 2 )] - In [c (1) c (2) ] = Z-lnC = a (15) 

i.e., a is an additive function. 

In terms of explicit arguments, we have 

cr(ft) = cr^ 1 ))!!^)) + cr( 2 )(fi( 2 )). (16) 

After the subsystems have been combined, a minimumfor the function cr(Sl) will occur at some value SI = SI; 
since we keep track of all the modes of the system, SI can be uniquely written as a sum of two parts: 
SI = SI 1 - 1 ) +S1 1 ' 2 ), where SI 1 - 1 ) and SI 1 - 2 ) correspond to subsystems 1 and 2, respectively. Before the subsystems 
were combined, however, they had individual minima at Cli 1 ^ and ; therefore, 

o-W^ 1 )) > <tW(S 2W) and cr( 2 )(Sf( 2 )) > cr( 2 )(Sf( 2 )). (17) 

From this it immediately follows that the total entropy after combination is greater than or equal to the 
sum of the individual entropies si 1 ^ and which existed before combination: 

S = <r(S2) = O-W^ 1 )) +cr( 2 )(Sf( 2 )) 

> <tW(S2W) T^^) = sW+sW. (18) 

Thus, we have shown, for ideal fluid turbulence, that the quantity that has been defined as the entropy 
of an absolute equilibrium ensemble satisfies the necessary condition that the total entropy is always greater 
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than or equal to the sum of the entropies of the two systems prior to their interaction: S > 5'o 1 ' 1 + sl 2 \ Note 
that there is no ‘time evolution’ occurring here: the instant two previously isolated systems are merged, the 
entropy of the new combined system is established. The new system may then evolve from one microstate 
to another ‘more probable’ one; the new entropy, however, remains fixed in value. 

5 Discussion 

An analogous discussion of H(f) = — f flnfdX can be given: H can take different values, depending on the 
instantaneous form of /; however, only one particular value of / corresponds to an equilibrium, or average, 
value. Let this value be denoted by /: the entropy is S = H(f). If the system is started off at some less 
probable distribution, denoted by / 0 , then H has the value H(f 0 ), which is not the entropy, since an isolated 
system (in a canonical sense) has only one value for its entropy, H(f). 

Both <7 and H can be called ‘pre-entropies’ as it is imprecise to call them ‘entropies.’ The function H(f) 
increases as / — > f until it reaches a maximum of H(f): this is the entropy. The function cr(Sl) decreases 
as SI — > SI until it reaches a minimum of cr(fi): this is also the entropy. Both H(f) and cr(Sl) may fluctuate 
since the instantaneous form of / and the instantaneous value of SI fluctuate. Neither of these, however, are 
the entropy for an isolated system, which has a fixed, non-fluctuating value. 

The function cr(Sl) is useful, as Khinchin (1949) points out, and as was shown in (18), in that it can 
be used to demonstrate the non-decreasing nature of entropy. It is also useful because the inverse of the 
normalizing coefficient C , as given in (4), is the so-called partition function of statistical mechanics (Landau 

6 Lifshitz 1980, p. 91), and thus, connects the statistical analysis of ideal fluids to the main body of classical 
statistical mechanics. Furthermore, if we use (11) to write S = aE+/3Hk—lriC(il), then we have dS/dE = a 
and dS/dHk = /?, which generalizes the well-known thermodynamic result dS/dE = 1/T (Landau & Lifshitz 
1980, p. 35) to the case of more than one temperature (here, T — > a -1 , /3 _1 ). 

Finally, a comment on the entropy function Hq = \ In |u(k )| 2 of Carnevale, Frisch & Salmon (1981) 
and Carnevale (1982). On looking at (6), we see that |u(k )| 2 = 3a/ (a 2 — (] 2 k 2 ); then, from (13), Hq — 
2<r/3 ~ Z In a. Thus, the entropy function Hq appears to have an additional term when compared with a, 
and is therefore inconsistent with absolute equilibrium ensemble theory. However, /? — y 0 in the limit of zero 
kinetic helicity, and the essential difference between Hq and cr disappears. 
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6 Conclusion 


In this paper, we have developed the notion of entropy within the framework of the absolute equilibrium 
ensemble theory of ideal fluids. This has enabled a discussion of the distinction between the entropy S of an 
isolated system and the quantities H and cr: S is independent of time for an isolated system, while H is a 
time-dependent measure of a system’s evolution to a ‘most probable’ state, and cr allows for the analytical 
demonstration of the law of increase of entropy when two isolated systems are combined. Recognizing the 
distinction between H and cr also obviates Loschmidt’s paradox, which is discussed by Carnevale (1982). 

Although much reference was given here to the work of Khinchin (1949), it should be noted that there are 
more modern treatments of this subject (e.g., Sinai 1994). However, these modern works have a much more 
abstruse character for non-mathematicians; this, along with the general completeness, for our purposes, of 
the work of Khinchin (1949), has guided our choice of reference. The book by Khinchin (1949), translated 
by Gamow, is well worth reading. 
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